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Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .1 36(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 1 33). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )□ Responsive to communication(s) filed on . 

2a)K This action is FINAL. 2b)n This action is non-final. 

3) 0 Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 . 453 O.G. 213. 

Disposition of Claims 

4) ^ Claim{s) 1-12 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) \3 Claim{s) is/are allowed. 

6) ^ Claim{s) 1-12 is/are rejected. 
?)□ Claim(s) is/are objected to. 

8) 0 Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) 0 The specification is objected to by the Examiner. 

10)^ The drawing(s) filed on 01 April 2004 is/are: a)S accepted or b)^ objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 

Replacement drawing sheet{s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 
1 1 )D The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-1 52. 

Priority under 35 U.S.C. § 119 

12)^ Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 
bM All b)n Some * c)^ None of: 

1 Certified copies of the priority documents have been received. 

2. n Certified copies of the priority documents have been received in Application No. . 

3. n Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 
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DETAILED ACTION 
Drawings 

1. The drawings were received on April 1, 2004. These drawings are accepted. 

Response to Arguments 

2. Applicant's arguments filed April 1, 2004 have been fully considered but they are not 
persuasive. 

The Applicant allege that Sun et al do not teach or suggest controlling a code amount of 
an object having a predetermined priority order among plural objects, when the total code 
amount of the plural objects exceeds a predetermined code amount. The Examiner respectfully 
disagrees. As the Applicant explains on page 8, lines 14-16 of the remarks. Sun et al teach in 
column 9, lines 40-63 that a code amount T[i] is determined for each object in a frame based on 
the object's size, motion, and variation. This code amount corresponds to a priority order 
because an object with a higher allocated code amount T[i] is given a higher priority (or 
significance) in the frame and is therefore, allotted a greater number of bits for encoding within 
the constant number of total bits allocated for each frame. Thus, just as the priority number of 
the present invention assigns a significance to each object and encodes objects having a higher 
priority at a higher bit rate, Sun et al assign each object a code amount T[i] and also encode 
objects having a higher code amount (or priority) at a higher bit rate. 

Claim Rejections - 35 USC § 102 

3. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 
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(e) the invention was described in (1) an application for patent, published under section 122(b), by another filed 
in the United States before the invention by the applicant for patent or (2) a patent granted on an application for 
patent by another filed in the United States before the invention by the applicant for patent, except that an 
international application filed under the treaty defined in section 351(a) shall have the effects for purposes of this 
subsection of an application filed in the United States only if the international application designated the United 
States and was published under Article 21(2) of such treaty in the English language. 

4. Claims 1-5 and 7-12 are rejected under 35 U.S.C. 102(e) as being anticipated by Sun et al 
(U.S. Patent No. 5,969,764). 

Referring to claim 1, which is representative of claims 1 1 and 12, 

i. Inputting means for inputting image data of plural objects is illustrated by Sun et 
al in figure 5 by the digital image source (10). 

ii. Encoding means for encoding, with encoding conditions, the image data inputted 
by the input means on an object basis is explained by Sun et al in column 4, lines 43-51. 
Sun et al explain that the video signal encoder (12 of figure 5) is provided image 
information on a Video Object basis, corresponding to the general encoding method of 
MPEG-4. The encoding conditions are explained by Sim et al by the code amount 
assigned to each video object as explained in column 9, lines 40-63. 

iii. Control means for setting a priority order of code amount allocation for each of 
the objects and in accordance with the priority order, controlling the encoding conditions 
of the object having a predetermined priority order is explained by Sun et al in column 6, 
line 56 to column 7, line 4 and column 9, lines 40-63. Sun et al explain that bits available 
in a buffer (column 6, lines 28-35) are redistributed according to a priority allocation 
amount of the objects, which is determined based on the size of the object and the amount 
of activity that the object is experiencing. The equation to determine the allocation 
amount is based on weighted motion, size, and mean absolution difference parameters. 
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Therefore, objects with a greater size, motion, or mean absolute difference would be 
given a higher priority and thereby allocated a larger number of bits for encoding, 
iv. The control means setting a priority order of code amount allocation when a total 
code amount obtained by encoding the image data of the plural objects exceeds a 
predetermined code amount is explained by Sun et al in column 6, lines 28-35 wherein 
the predetermined code amount is given by the target rate, which cannot be exceeded. 
Referring to claim 2, the control means changing the priority order at a predetermined 
timing is explained by Sun et al in column 9, lines 40-42. Sun et al explain that the objects are 
encoded at the same frame rate and therefore the priority order of each object would be 
determined for every frame, corresponding to a predetermined timing. 

Referring to claim 3, the predetermined timing being determined according to how many 
times a code amount reduction processing for the objects is executed or according to code 
amounts of the objects is explained by Sun et al in column 9, Hnes 40-42. Sun et al explain that 
the priority bit allocation amount of each video object is determined in each frame. Therefore, 
when each video object has been processed once, then the system of Sun et al will process the 
next object. Therefore, the system of Sun et al changes the priority bit allocation amount of each 
object according to how many times the processing has been performed for each object. 

Referring to claim 4, when the code amount of an object set to a lowest priority becomes 
smaller than a predetermined lower limit value, the control means setting another object to the 
lowest priority is explained by Sun et al in column 6, line 64 to column 7, line 4. Sun et al 
explain if lower bound constraints on the bits used to encode an object are exceeded, then the 
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system will invoke the pre-frame skip control. By skipping frames, the bit allocation to an object 
can be increased so that the lower bound constraints are not met. 

Referring to claim 5, the encoding means breaking down the image data of the objects 
into pixel data and shape data and encoding the pixel data and shape data and the control means 
determining the priority order in accordance with a size of shape data of the objects is explained 
by Sun et al in the abstract and in column 9, lines 40-64. Sun et al explain in the abstract that the 
texture (corresponding to the pixel data), motion, and shape data of each object is encoded. The 
priority order of the bit allocation of the objects is explained to be a function of the motion, size, 
and mean absolute difference of each object. Therefore, objects with a greater size, motion, or 
mean absolute difference would be given a higher priority and thereby allocated a larger number 
of bits for encoding. 

Referring to claim 7, the encoding means including quantization means for quantizing the 
image data of the objects and quantization parameters of the quantization means being controlled 
by the encoding conditions is explained by Sun et al in column 9, lines 21-27 and illustrated in 
figure 3. The quantization means (25) determines the quantization parameters according to the 
target distribution (32). 

Referring to claim 8, a recording means for recording the data encoded by the encoding 
means into a recording medium is illustrated by Sun et al in figure 5 by the buffer (17). 

Referring to claim 9, the inputting means comprising image pickup means for 
photographing an object image and generating image data is illustrated by Sun et al in figure 5 
by the digital image source (10). 
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Referring to claim 10, a video camera being provided with the image processing 
apparatus is data is illustrated by Sun et al in figure 5 by the digital image source (10) connected 
to the image processing apparatus (12). Sun et al explain in the abstract that the image 
processing is performed on video data, which is captured by a video camera. 

Claim Rejections - 35 USC § 103 

5. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

6. Claim 6 is rejected under 35 U.S.C. 103(a) as being unpatentable over Sun et al in view 
of Suzuki et al (U.S. Patent No. 6,415,057). 

Referring to claim 6, the encoding means executing the encoding operation in accordance 
with MPEG-4 and the control means determining the priority order in accordance with the sizes 
of the bounding boxes of the objects is explained by Sun et al in column 4, lines 59-65. Sun et al 
explain that the encoding is performed as described according to the MPEG-4 standard. 
However, Sun et al do not explicitly explain using bounding boxes to describe the size of the 
objects. Suzuki et al illustrate using bounding boxes to explain the dimensions of an object in 
figures 1 1 A and 1 IB. By using bounding boxes to describe the dimensions of an object, the area 
of the box can be determined by a simple multiplication of the two dimensions in order to 
determine the bit allocation amount for the object in the system of Sun et al. Therefore, it would 
have been obvious to one of ordinary skill in the art at the time the invention was made to use a 
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bounding box to explain the size of an object so that the object size is described more efficiently 
as it is a function of only two variables. 

Conclusion 

7. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS fi-om the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the mailing 
date of this final action. 

8. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Hussein Akhavannik whose telephone number is (703)306-4049. 
The examiner can normally be reached on M-F 8:30-5:00. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Leo H. Boudreau can be reached on (703)305-4706. The fax phone number for the 
organization where this application or proceeding is assigned is 703-872-9306. 
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Information regarding the status of an application may be obtained from the Patent 
Apphcation Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 



Hussein Akhavannik 
May 10, 2004 




